Triage and Diagnostic Accuracy of Online Symptom Checkers: Systematic Review.

BACKGROUND: In the context of a deepening global shortage of health workers and, in particular, the COVID-19 pandemic, there is growing international interest in, and use of, online symptom checkers (OSCs). However, the evidence surrounding the triage and diagnostic accuracy of these tools remains inconclusive. OBJECTIVE: This systematic review aimed to summarize the existing peer-reviewed literature evaluating the triage accuracy (directing users to appropriate services based on their presenting symptoms) and diagnostic accuracy of OSCs aimed at lay users for general health concerns. METHODS: Searches were conducted in MEDLINE, Embase, CINAHL, Health Management Information Consortium (HMIC), and Web of Science, as well as the citations of the studies selected for full-text screening. We included peer-reviewed studies published in English between January 1, 2010, and February 16, 2022, with a controlled and quantitative assessment of either or both triage and diagnostic accuracy of OSCs directed at lay users. We excluded tools supporting health care professionals, as well as disease- or specialty-specific OSCs. Screening and data extraction were carried out independently by 2 reviewers for each study. We performed a descriptive narrative synthesis. RESULTS: A total of 21,296 studies were identified, of which 14 (0.07%) were included. The included studies used clinical vignettes, medical records, or direct input by patients. Of the 14 studies, 6 (43%) reported on triage and diagnostic accuracy, 7 (50%) focused on triage accuracy, and 1 (7%) focused on diagnostic accuracy. These outcomes were assessed based on the diagnostic and triage recommendations attached to the vignette in the case of vignette studies or on those provided by nurses or general practitioners, including through face-to-face and telephone consultations. Both diagnostic accuracy and triage accuracy varied greatly among OSCs. Overall diagnostic accuracy was deemed to be low and was almost always lower than that of the comparator. Similarly, most of the studies (9/13, 69 %) showed suboptimal triage accuracy overall, with a few exceptions (4/13, 31%). The main variables affecting the levels of diagnostic and triage accuracy were the severity and urgency of the condition, the use of artificial intelligence algorithms, and demographic questions. However, the impact of each variable differed across tools and studies, making it difficult to draw any solid conclusions. All included studies had at least one area with unclear risk of bias according to the revised Quality Assessment of Diagnostic Accuracy Studies-2 tool. CONCLUSIONS: Although OSCs have potential to provide accessible and accurate health advice and triage recommendations to users, more research is needed to validate their triage and diagnostic accuracy before widescale adoption in community and health care settings. Future studies should aim to use a common methodology and agreed standard for evaluation to facilitate objective benchmarking and validation. TRIAL REGISTRATION: PROSPERO CRD42020215210; https://tinyurl.com/3949zw83.

A mixed-methods study describing behavioral factors that influenced general practitioners' experiences using triage during the COVID-19 pandemic.

BACKGROUND: Early in the COVID-19 pandemic, general practices were asked to expand triage and to reduce unnecessary face-to-face contact by prioritizing other consultation modes, e.g., online messaging, video, or telephone. The current study explores the potential barriers and facilitators general practitioners experienced to expanding triage systems and their attitudes towards triage during the COVID-19 pandemic. METHOD: A mixed-method study design was used in which a quantitative online survey was conducted along with qualitative interviews to gain a more nuanced appreciation for practitioners' experiences in the United Kingdom. The survey items were informed by the Theoretical Domains Framework so they would capture 14 behavioral factors that may influence whether practitioners use triage systems. Items were responded to using seven-point Likert scales. A median score was calculated for each item. The responses of participants identifying as part-owners and non-owners (i.e., "partner" vs. "non-partner" practitioners) were compared. The semi-structured interviews were conducted remotely and examined using Braun and Clark's thematic analysis. RESULTS: The survey was completed by 204 participants (66% Female). Most participants (83%) reported triaging patients. The items with the highest median scores captured the 'Knowledge,' 'Skills,' 'Social/Professional role and identity,' and 'Beliefs about capabilities' domains. The items with the lowest median scores captured the 'Beliefs about consequences,' 'Goals,' and 'Emotions' domains. For 14 of the 17 items, partner scores were higher than non-partner scores. All the qualitative interview participants relied on a phone triage system. Six broad themes were discovered: patient accessibility, confusions around what triage is, uncertainty and risk, relationships between service providers, job satisfaction, and the potential for total digital triage. Suggestions arose to optimize triage, such as ensuring there is sufficient time to conduct triage accurately and providing practical training to use triage efficiently. CONCLUSIONS: Many general practitioners are engaging with expanded triage systems, though more support is needed to achieve total triage across practices. Non-partner practitioners likely require more support to use the triage systems that practices take up. Additionally, practical support should be made available to help all practitioners manage the new risks and uncertainties they are likely to experience during non-face-to-face consultations.

Digital triage for people with multiple sclerosis in the age of COVID-19 pandemic.

We propose a possible approach for the remote monitoring of infection risk in people with multiple sclerosis, especially those on immunosuppressant drugs, during COVID-19 pandemic. We developed a digital triage tool to be sent to patients to quickly identify people with high risk of COVID-19 infection. This tool will also limit unnecessary accesses to the MS centers reducing the risk of spreading the infection.